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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )M Responsive to communication(s) filed on 16 June 2000 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 1-13 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-13 is/are rejected. 

7) M Claim(s) *see action* is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 16 June 2000 is/are: a)D accepted or b)E3 objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in repty to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (0- 

a>n All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

1 5) ^ Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 1 20 and/or 1 21 . 

Attachment! s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 

1. Claims 1-13 have been examined. 



Specification 

2. The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 

3. The disclosure is objected to because of the following informalities: On page 1, 
the sentence beginning with "The inventors have provided.. on line 26, should be 
removed since no IDS was filed with this patent application. Please insert -to— after 
"related" on page 3, line 20. Please correct the spacing and indentation of words on page 
8, lines 1-9. Also, insert -be-- after "will" on page 8, line 13. Insert -a— before "DMS" 
on page 10, line 7. Replace the first occurrence of "producer" with —consumer— on page 
13, line 13. Finally, on page 14, line 21, should "Figure 3" be changed to -Figure 4—? 

Appropriate correction is required. 



Drawings 

4. Fig.4 is objected to for not being mentioned or explained within the specification. 

Claim Objections 

5. It is suggested that the applicant use either "hit-miss" or "hit/miss" when referring 
to the type of predictor, but not both. Multiple claims use one or the other or both 
formats. The usage of this phrase should be uniform throughout the claims. 
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Claim Rejections - 35 USC §103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 1-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Parady, U.S. Patent No. 5,933,627, in view of McFarling et al., U.S. Patent No. 5,758, 142 
(herein referred to as McFarling). 

8. Referring to claim 1, Parady has taught in a multi-streaming processor having a 
data cache, a system for fetching instructions from individual ones of the multiple 
streams to a pipeline, comprising: 

a) a fetch algorithm for selecting from which stream to fetch instructions. See the 
abstract. 

b) Parady has not taught a hit/miss predictor for forecasting whether instructions will hit 
or miss the data cache wherein the prediction by the hit/miss predictor is used by the 
fetch algorithm in determining from which stream to fetch. However, McFarling has 
taught a hit/miss predictor that is used to predict, for load instructions, whether a cache 
hit or miss will occur. And, if a cache miss is predicted to occur, then instructions 
independent of the load are scheduled ahead of the load-dependent instructions. See 
column 3, lines 7-18. A person of ordinary skill in the art would have recognized that 
this prediction scheme would be useful in a multi-streaming (multithreaded) environment 
because a thread is a sequence (stream) of instructions that is independent from other 
threads (i.e. other sequences of instructions), as is known in the art. By implementing 
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such a prediction scheme into the system of Parady, thread switches can occur sooner, 
thereby maximizing efficiency through execution of load-independent instructions. 
Consequently, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify the thread-switching system of Parady to include a hit/miss 
predictor as taught by McFarling, in order to switch threads before the load reaches the 
execution stage, thereby preventing a drop-off in throughput. 

9. Referring to claim 2, Parady in view of McFarling has taught a system as 
described in claim 1 . Furthermore, McFarling has taught that a hit prediction precipitates 
no change in the fetching process, i.e., the instructions dependent on the load will not be 
preempted by instructions independent of the load. See column 3, lines 7-18, and column 
8, lines 28-49. This feature is part of McFarling's predictor, which as discussed in the 
rejection of claim 1, would have been obvious to one of ordinary skill in the art at the 
time of the invention to implement in Parady' s system. In the combined 
Parady/McFarling system, if a hit prediction occurs, then instructions from the same 
thread will be fetched and executed (these would be instructions from the same stream). 

10. Referring to claim 3, Parady in view of McFarling has taught a system as 
described in claim 1 . Furthermore, McFarling has taught that a miss prediction results in 
switching fetching to a different stream, i.e., the instructions dependent on the load will 
be preempted by instructions independent of the load. See column 3, lines 7-18, and 
column 8, lines 28-49. This feature is part of McFarling's predictor, which as discussed 
in the rejection of claim 1, would have been obvious to one of ordinary skill in the art at 
the time of the invention to implement in Parady 5 s system. In the combined 
Parady/McFarling system, if a miss prediction occurs, then instructions from a different 
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thread will be fetched and executed (these would be instructions from a load-independent 
stream). 

11. Referring to claim 4, Parady in view of McFarling has taught a system as 
described in claim 1. Furthermore, McFarling has taught the hit/miss predictor 
determines a hit probability, and the probability is used by the fetch algorithm in 
determining from where to fetch next instructions. See column 8, line 50, to column 9, 
line 33. Note that a 2-bit saturating counter (doesn't wrap-around) exists for each load 
instruction within the program. This counter is incremented if the load hits the cache and 
decremented if the load misses the cache. The most significant bit is then used to make 
the prediction (i.e. if the counter equals 10 or 1 1, a hit is predicted, otherwise a miss is 
predicted). Therefore, it can be seen that if the load always hits, the counter will saturate 
at a binary value of 1 1, which would always result in a hit prediction. This predictor 
determines a hit probability in that each possible value of the counter represents a 
different probability based on past experience. The higher the counter value, the higher 
the hit probability. For instance, a counter value of 1 1 signifies a load instruction that has 
hit the cache recently. Therefore, it will be predicted with a high hit probability. On the 
other hand, a counter value of 00 signifies a load instruction that has missed the cache 
recently. Therefore, it will be predicted with no hit probability, i.e., it will be predicted to 
miss. Generally, these extreme values (00 and 1 1) are considered to be strongly taken 
and strongly not-taken prediction values, respectively. Counter values of 01 and 10 can 
be considered not-taken and taken prediction values, respectively, but the probability is 
less that it will miss and less that it will hit, respectively. As a result, it can be seen that 
as the counter value increases, so does the hit probability, thereby indicating that a load 
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with a counter value of 1 1 is much more likely to hit the cache than a load with a counter 
value of 00, according to past encounters. This feature is part of McFarling' s predictor, 
which as discussed in the rejection of claim 1, would have been obvious to one of 
ordinary skill in the art at the time of the invention to implement in Parady's system. 
Note from above that the prediction directly results in what instruction are executed next. 
Therefore, in the combined Parady/McFarling system, higher probability hit predictions 
will result in fetching from a different stream. Likewise, low probability hit predictions 
(miss predictions) will result in fetching from the same stream. 
12. Referring to claim 5, Parady in view of McFarling has taught a system as 
described in claim 1. Furthermore, McFarling has taught that the forecast of the hit/miss 
predictor is also used by a dispatch algorithm in selecting instructions from the pipeline 
to dispatch to functional units. See column 3, lines 7-18, and column 8, lines 28-49, and 
note that when a miss occurs, the dispatcher will dispatch instructions based on the 
prediction. For example, if a hit prediction occurs, the dispatcher will continue 
dispatching instructions that may be dependent on the load. However, if a miss 
prediction occurs, the dispatcher will dispatch instructions that are independent of the 
load so that they do not have to wait for the result. This feature is part of McFarling's 
predictor, which as discussed in the rejection of claim 1, would have been obvious to one 
of ordinary skill in the art at the time of the invention to implement in Parady's system. 
In the combined Parady/McFarling system the dispatcher would work in the same 
fashion, i.e., if a hit prediction occurs, instructions from the same stream which may be 
dependent on the load can continue to be dispatched, while if a miss prediction occurs, 
then instructions from a different thread (independent of the load) will be dispatched. 
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13. Referring to claim 6, Parady has taught a multi-streaming processor comprising: 

a) a data cache. See Fig.l, component 56, and Fig.2, component 82. 

b) a fetch algorithm for selecting from which stream to fetch instructions. See the 
abstract. 

c) Parady has not taught a hit/miss predictor for predicting whether instructions will hit or 
miss the cache wherein a prediction by the hit/miss predictor is used by the fetch 
algorithm in determining from where stream to fetch. However, McFarling has taught a 
hit/miss predictor that is used to predict, for load instructions, whether a cache hit or miss 
will occur. And, if a cache miss is predicted to occur, then instructions independent of 
the load are scheduled ahead of the load-dependent instructions. See column 3, lines 7- 
18. A person of ordinary skill in the art would have recognized that this prediction 
scheme would be useful in a multi-streaming (multithreaded) environment because a 
thread is a sequence (stream) of instructions that is independent from other threads (i.e. 
other sequences of instructions), as is known in the art. By implementing such a 
prediction scheme into the system of Parady, thread switches can occur sooner, thereby 
maximizing efficiency through execution of load-independent instructions. 
Consequently, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify the thread-switching system of Parady to include a hit/miss 
predictor as taught by McFarling, in order to switch threads before the load reaches the 
execution stage, thereby preventing a drop-off in throughput. 

14. Referring to claim 7, Parady in view of McFarling has taught a processor as 
described in claim 6. Furthermore, McFarling has taught that a hit prediction precipitates 
no change in the fetching process, i.e., the instructions dependent on the load will not be 
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preempted by instructions independent of the load. See column 3, lines 7-18, and column 
8, lines 28-49. This feature is part of McFarling's predictor, which as discussed in the 
rejection of claim 6, would have been obvious to one of ordinary skill in the art at the 
time of the invention to implement in Parady's processor. In the combined 
Parady/McFarling system, if a hit prediction occurs, then instructions from the same 
thread will be fetched and executed (these would be instructions from the same stream). 

15. Referring to claim 8, Parady in view of McFarling has taught a processor as 
described in claim 6. Furthermore, McFarling has taught that a miss prediction results in 
switching fetching to a different stream, i.e., the instructions dependent on the load will 
be preempted by instructions independent of the load. See column 3, lines 7-18, and 
column 8, lines 28-49. This feature is part of McFarling's predictor, which as discussed 
in the rejection of claim 6, would have been obvious to one of ordinary skill in the art at 
the time of the invention to implement in Parady's processor. In the combined 
Parady/McFarling system, if a miss prediction occurs, then instructions from a different 
thread will be fetched and executed (these would be instructions from a load-independent 
stream). 

16. Referring to claim 9, Parady in view of McFarling has taught a processor as 
described in claim 6. Furthermore, McFarling has taught the hit/miss predictor 
determines a hit probability, and the probability is used by the fetch algorithm in 
determining from where to fetch next instructions. See column 8, line 50, to column 9, 
line 33. Note that a 2-bit saturating counter (doesn't wrap-around) exists for each load 
instruction within the program. This counter is incremented if the load hits the cache and 
decremented if the load misses the cache. The most significant bit is then used to make 
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the prediction (i.e. if the counter equals 10 or 1 1, a hit is predicted, otherwise a miss is 
predicted). Therefore, it can be seen that if the load always hits, the counter will saturate 
at a binary value of 1 1, which would always result in a hit prediction. This predictor 
determines a hit probability in that each possible value of the counter represents a 
different probability based on past experience. The higher the counter value, the higher 
the hit probability. For instance, a counter value of 1 1 signifies a load instruction that has 
hit the cache recently. Therefore, it will be predicted with a high hit probability. On the 
other hand, a counter value of 00 signifies a load instruction that has missed the cache 
recently. Therefore, it will be predicted with no hit probability, i.e., it will be predicted to 
miss. Generally, these extreme values (00 and 1 1) are considered to be strongly taken 
and strongly not-taken prediction values, respectively. Counter values of 01 and 10 can 
be considered not-taken and taken prediction values, respectively, but the probability is 
less that it will miss and less that it will hit, respectively. As a result, it can be seen that 
as the counter value increases, so does the hit probability, thereby indicating that a load 
with a counter value of 1 1 is much more likely to hit the cache than a load with a counter 
value of 00, according to past encounters. This feature is part of McFarling's predictor, 
which as discussed in the rejection of claim 6, would have been obvious to one of 
ordinary skill in the art at the time of the invention to implement in Parady's processor. 
Note from above that the prediction directly results in what instruction are executed next. 
Therefore, in the combined Parady/McFarling system, higher probability hit predictions 
will result in fetching from a different stream. Likewise, low probability hit predictions 
(miss predictions) will result in fetching from the same stream. 



:A>i 
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17. Referring to claim 10, Parady in view of McFarling has taught a processor as 
described in claim 6. Furthermore, McFarling has taught that the forecast of the hit/miss 
predictor is also used by a dispatch algorithm in selecting instructions from the pipeline 
to dispatch to functional units. See column 3, lines 7-18, and column 8, lines 28-49, and 
note that when a miss occurs, the dispatcher will dispatch instructions based on the 
prediction. For example, if a hit prediction occurs, the dispatcher will continue 
dispatching instructions that may be dependent on the load. However, if a miss 
prediction occurs, the dispatcher will dispatch instructions that are independent of the 
load so that they do not have to wait for the result. This feature is part of McFarling 5 s 
predictor, which as discussed in the rejection of claim 6, would have been obvious to one 
of ordinary skill in the art at the time of the invention to implement in Parady' s processor. 
In the combined Parady/McFarling system the dispatcher would work in the same 
fashion, i.e., if a hit prediction occurs, instructions from the same stream which may be 
dependent on the load can continue to be dispatched, while if a miss prediction occurs, 
then instructions from a different thread (independent of the load) will be dispatched. 

18. Referring to claim 11, Parady has taught in a multi-streaming processor having a 
data cache (see Fig.l, component 56, and Fig.2, component 82), a method for fetching 
instructions from individual ones of multiple streams as instruction sources to a pipeline 
(see the abstract). Parady has not taught making a hit/miss prediction by a predictor as to 
whether instructions previously fetched will hit or miss the data cache, and if the 
prediction is a miss, altering the source of the fetch. However, McFarling has taught a 
hit/miss predictor that is used to predict, for load instructions, whether a cache hit or miss 
will occur. And, if a cache miss is predicted to occur, then instructions independent of 
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the load are scheduled ahead of the load-dependent instructions. See column 3, lines 7- 

18. A person of ordinary skill in the art would have recognized that this prediction 
scheme would be useful in a multi-streaming (multithreaded) environment because a 
thread is a sequence (stream) of instructions that is independent from other threads (i.e. 
other sequences of instructions), as is known in the art. By implementing such a 
prediction scheme into the system of Parady, thread switches can occur sooner, thereby 
maximizing efficiency through execution of load-independent instructions. 
Consequently, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify the thread-switching system of Parady to include a hit/miss 
predictor as taught by McFarling, in order to switch threads before the load reaches the 
execution stage, thereby preventing a drop-off in throughput. 

19. Referring to claim 12, Parady in view of McFarling has taught a method as 
described in claim 1 1 . Furthermore, McFarling has taught the hit/miss predictor 
determines a hit probability, and the probability is used by the fetch algorithm in 
determining from where to fetch next instructions. See column 8, line 50, to column 9, 
line 33. Note that a 2-bit saturating counter (doesn't wrap-around) exists for each load 
instruction within the program. This counter is incremented if the load hits the cache and 
decremented if the load misses the cache. The most significant bit is then used to make 
the prediction (i.e. if the counter equals 10 or 1 1, a hit is predicted, otherwise a miss is 
predicted). Therefore, it can be seen that if the load always hits, the counter will saturate 
at a binary value of 1 1, which would always result in a hit prediction. This predictor 
determines a hit probability in that each possible value of the counter represents a 
different probability based on past experience. The higher the counter value, the higher 
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the hit probability. For instance, a counter value of 1 1 signifies a load instruction that has 
hit the cache recently. Therefore, it will be predicted with a high hit probability. On the 
other hand, a counter value of 00 signifies a load instruction that has missed the cache 
recently. Therefore, it will be predicted with no hit probability, i.e., it will be predicted to 
miss. Generally, these extreme values (00 and 1 1) are considered to be strongly taken 
and strongly not-taken prediction values, respectively. Counter values of 01 and 10 can 
be considered not-taken and taken prediction values, respectively, but the probability is 
less that it will miss and less that it will hit, respectively. As a result, it can be seen that 
as the counter value increases, so does the hit probability, thereby indicating that a load 
with a counter value of 1 1 is much more likely to hit the cache than a load with a counter 
value of 00, according to past encounters. This feature is part of McFarling's predictor, 
which as discussed in the rejection of claim 1 1, would have been obvious to one of 
ordinary skill in the art at the time of the invention to implement in Parady's method. 
Note from above that the prediction directly results in what instruction are executed next. 
Therefore, in the combined Parady/McFarling system, higher probability hit predictions 
will result in fetching from a different stream. Likewise, low probability hit predictions 
(miss predictions) will result in fetching from the same stream. 
20. Referring to claim 13, Parady in view of McFarling has taught a method as 
described in claim 1 1 . Furthermore, McFarling has taught that the forecast of the hit/miss 
predictor is also used by a dispatch algorithm in selecting instructions from the pipeline 
to dispatch to functional units. See column 3, lines 7-18, and column 8, lines 28-49, and 
note that when a miss occurs, the dispatcher will dispatch instructions based on the 
prediction. For example, if a hit prediction occurs, the dispatcher will continue 



Application/CWfol Number: 09/595,776 V Page 1 3 

Art Unit: 2183 

dispatching instructions that may be dependent on the load. However, if a miss 
prediction occurs, the dispatcher will dispatch instructions that are independent of the 
load so that they do not have to wait for the result. This feature is part of McFarling's 
predictor, which as discussed in the rejection of claim 1, would have been obvious to one 
of ordinary skill in the art at the time of the invention to implement in Parady's method. 
In the combined Parady/McFarling system the dispatcher would work in the same 
fashion, i.e., if a hit prediction occurs, instructions from the same stream which may be 
dependent on the load can continue to be dispatched, while if a miss prediction occurs, 
then instructions from a different thread (independent of the load) will be dispatched. 

Conclusion 

21 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Applicant is reminded that in amending in response to a rejection 
of claims, the patentable novelty must be clearly shown in view of the state of the art 
disclosed by the references cited and the objections made. Applicant must also show 
how the amendments avoid such references and objections. See 37 CFR §1.1 1 1(c). 

Gottlieb et al., U.S. Patent No. 6,016,542, has taught detecting long latency 
pipeline stalls for thread switching. 

Okin, U.S. Patent No. 5,361,337, has taught a method and apparatus for rapidly 
switching processes in a computer system. More specifically, Okin has disclosed a 
system in which processes are switched when a cache miss occurs. 

Morris et al., U.S. Patent No. 6,308,261, has taught a computer system having an 
instruction for probing memory latency. 
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Yoaz et al., Speculation Techniques for Improving Load Related Instruction 
Scheduling, 1999, pages 42-53, has taught that multithreading environments would 
benefit from load hit-miss prediction in that the prediction may be used to govern a 
thread switch if a load is predicted to miss a level-2 cache. 

Kessler, R.E., The Alpha 21264 Microprocessor: Out-of-Order Execution at 600 
Mhz, August 1998, pages 18-19, has taught predicting load hits and misses and how the 
system operates based on those predictions. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to David J. Huisman whose telephone number is (703) 305- 
781 1. The examiner can normally be reached on Monday-Friday (8:00-4:30). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Eddie Chan can be reached on (703) 305-9712. The fax phone numbers for 
the organization where this application or proceeding is assigned are (703) 746-7239 for 
regular communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703) 305- 
3900. 



DJH 

David J. Huisman 
May 8, 2003 




